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1 Introduction 

For d > 2, let D CI W^ be a domain. Consider the two-player, zero-sum game in D known as 
the tug-of-war with noise. Here is a rough description — we wih be precise below: Suppose e > 
and p > 1. The game starts at a position x & D. A fair coin is tossed at each stage of the game 
and the winner picks w € M'^ with |t;| < e to add to the game position. Then a random noise vector 
with mean and variance ^e^ (where q is the conjugate of p) in each orthogonal direction is added 
to the game position. The game terminates when the position reaches a point on the boundary of 
D. 

We have in mind that player I seeks to prolong the game as long as possible while player II 
wants to end the game as soon as possible. The goal of this article is to see how the geometry of 
the domain affects the expected time to end the game. In particular, we study the special case of 
a wedge in two dimensions. 

Denote the wedge in M^ with angle rj € (0, 27r) by 



Wr, = {{r,e):r>0, -| < ^ < |} , 



where r and 9 are the usual polar coordinates. In the sequel, we use Ex to denote expectation 
associated with the game starting at the position x. 

Theorem 1.1. // 

then there is Eq > along with a strategy for player II such that the time r to end the game in Wr^ 
satisfies 

sup sup e -E'2;j, [r] < oo, xq G W^^, 

Si 0<e<eo 
where the first supremum is taken over all strategies for player I. 



Suppose the state space of the game is a bounded set D QMr and F : dD — )■ R is continuous. 
Peres and Sheffield (2008) have studied the tug-of-war in D, where the game is run so that when 
it ends at position y G dD, player I receives a payoff of F{y) from player II. Here F can take on 
positive or negative values, and so a negative payoff corresponds to player I paying player II. An 
important idea in that article is a connection between the game and the game p-Laplacian, which 
is the operator defined by 

Ap u := A^u = - iVnp-P div(| VnP-^ Vu). 
^ p 

One of their principal results is that if D is bounded and sufficiently regular, then as e — > 0, the 
expected payoff for player I converges to the unique p-harmonic extension of F to all of D. One 
can regard this result as an analogue of Kakutani's (1944) classical theorem that if Bf is Brownian 
motion in W^ and r is its exit time from D, then Ex[F{Bt-)] is the unique harmonic extension of F 
to D. 



Another very interesting result of Peres and Sheffield is the following. Suppose u{x) is sufficiently 
regular and satisfies ApU = —g in D, where g is bounded below by a positive constant. Modify 
the tug-of-war so that player I receives a running payoff of e^/(xfc) when the game position at 
the k step is Xk- Here, / is proportional to g and the constant of proportionality depends only 
on p and the underlying noise. Then as e — )• 0, the expected payoff for player I converges to u. 
This particular connection is why one uses the game p-Laplacian rather than the usual variational 
p-Laplacian given by 

A^u = dw{\Vu\P-^Vu). 

Note that when g = 1 and the boundary payoff F is zero, if r is the time to end the game, then 
the expected payoff is proportional to e'^Exlr]. Thus as e — )• 0, the limiting value of e'^Exlr] is 
proportional u. 

This observation and the following analogue for Brownian motion are what motivated our work. 
For the exit time td of d-dimensional Brownian motion from a Greenian domain D, it is well-known 
that if G{x, y) is Green's function for half the Dirichlet Laplacian on D, then 



Ex[td\ = / G{x,y)dx 
Jd 



(see Hunt (1956), page 309). Moreover, when D is bounded, under certain mild conditions on dD 
(see Dynkin and Yushkevich (1969), page 68), the function 

u{x) = Ex[td] 
is the unique solution of the boundary value problem 

iA-u = -1 in D 

(1.1) n = on dD. 

Thus if one can solve p.ip , then it follows that 

(1.2) Ex[td] < oo. 

When D is unbounded, the situation is more delicate, but it is not hard to show that if a nonnegative 
solution to (jl.ip exists, then by looking at bounded subdomains and using the maximum principle, 
(jl.2p holds. Thus the connection between the p-Laplacian and the tug-of-war suggests that study 
of the equation ApU = — 1 might yield information on the expected time to end the game. In fact, 
in order to prove Theorem II. 1|, we will make use of the following theorem. 

Theorem 1.2. Let p e (l,oo). // 

r] < TT 

then the boundary value problem 

Ap u = —1 in Wrj 
u = on dWr^ 




has a nonnegative solution u G C''^(VF^\{0}) n C{W.q) of the form u{x) = r'^ f{9). Moreover, u is 
positive on W^ and \Vu\ ^ on W^\{0}. 

Remark. When p = 1, we can get an implicit solution of the corresponding boundary value 
problem in terms of elementary functions. 

Although the purpose of this theorem is to prove Theorem 11.11 we feel it is of independent 
interest because it concerns a nonhomogeneous boundary value problem involving the p-Laplacian 
in an unbounded set. 

Several authors have studied nonhomogeneous partial differential equations involving the p- 
Laplacian in unbounded domains. For instance: 

• Liouville-type theorems and related results were obtained in the articles by Liskevich et al. 
(2007), Bidaut-Veron (1989) and Abdellaoui and Peral (2003). 

• Eigenvalue problems on M" were studied by Brown and Reichel (2004) for L''(M") eigenfunc- 
tions, while both Fleckinger et al. (1997) and Drabek (1995) considered positive eigenfunc- 
tions that decay to at infinity. 

• Eigenvalue problems on smooth unbounded domains with nonhomogeneous boundary con- 
ditions and eigenfunctions in weighted Sobolev spaces were the subject of the articles by 
Montefusco and Radulescu (2001) and Pfliiger (1998). Fleckinger et al. (1999) looked at the 
principal eigenvalue with L'' principal eigenfunction for Dirichlet boundary conditions. 

• In exterior domains, Yu (1992) considered decaying solutions of nonhomogeneous equations 
with Dirichlet boundary conditions. 

• Kristaly (2004) considered nonhomogeneous systems involving the p-Laplacian in unbounded 
strips with Dirichlet boundary conditions. 

In our result, we consider Dirichlet boundary conditions and explosion at infinity. 

Our proof of Theorem 11.21 shows that if rj is such that the boundary value problem 

ApU = —1 in Wri 
(1.3) u = on dWr^, 

has a solution in C'^{Wr]) n C{Wri) of the form u{x) = r'^ f{9), then necessarily 



r] < TT 



,_1 2(p-2) 
2V P 



But neither this nor Theorem 11.21 is helpful in determining whether or not ExItd] = oo. 
With the aid of Theorem II. H we can prove the following result. 



Theorem 1.3. There is a critical angle rjp with the following properties: 

i) If 7] < r]p, then there exists a strategy for player II such that if t is the time to end the game in 

Wn, then 

Exq[t] < oo, xo G Wn, 

regardless of the strategy used by player I. 

a) If r] > r]p, then for each strategy of player II, there is a strategy for player I such that 

£;a;Jr] = oo, XQ^Wri- 

An immediate corollary of Theorem II .11 is a lower bound on rjp-. 
Corollary 1.4. The critical angle rjp from Theorem I J . 31 satisfies 



??p > vr 



^-w-^ 



p 



The next result is a complement to this. 



Theorem 1.5. i) The critical angle rjp satisfies rjp < vr. 

ii) For nonconvex wedges W^, there is a strategy for player I such that 



^^Jr] = oo, xq e Wn, 



for every strategy of player II. 



There is an interesting connection with our lower bound on rjp and results of Aronsson (1986). 
His results can be shown to imply that there is ffp such that the boundary value problem 

Ap -u = in Wnp 
tt = on dW^:^ 



has a solution u e C (Wn^) fl C°° {Wn^\{0}) , positive on W^^, with the form u{x) = r^h{9). In 
fact, 



r]p 



vr 



1 2(p-l) 



2 V P 
which is exactly our lower bound on r/p. For Brownian motion, it is easy to show that the function 

u{x) = r cos 29 

satisfies n > on W^/2, u£C (W^) n C°° {W^\{0}) and 

Au = in W^/2 
u = on i9TV,r/2- 



Results and methods of Davis and Zhang (1994) or Burkholder (1977) can be used to show that 

Ex [tw^] < oo iff V < ^■ 
This leads us to conjecture that our lower bound on r]p is sharp: that is, 



Vp 



vr 




Our method is not refined enough to make this determination. 

In the case of Brownian motion, there is more known about the exit time from unbounded 
domains. In the case of axially symmetric cones in R (d > 2), Burkholder (1977) showed there 
is a critical angle for the cone in which the p moment of the exit time is finite. This result 
was extended to conditioned Brownian motion by Davis and Zhang (1994). DeBlassie (1987) and 
Bahuelos and Smits (1997) found series expansions for Px{td > t) for very general cones. The case 
of conditioned Brownian motion was also covered in the latter reference. The series expansions 
immediately show that Px{td > t) decays as a power of t, were the power depends on the geometry 
of the cone. For the parabolic domain 

D = {{x, y) G M^ : x > 0, |yl < x^/^}, 

Bahuelos et al. (2001) showed that 

Px{td > t) ^ e-^'"'' 

for large values of t. Our results shed some light on the corresponding situation for the tug-of-war. 
Since the domain 

DA,-y = {{{x, y) e M^ : x > 0, \y\ < Ax'^}, A>0, 0<7<1 

is contained in wedges of arbitrarily small aperture. Theorem 11.11 immediately yields the following 
corollary. 

Corollary 1.6. For the domain DA,'y, there exists a strategy for player II and eo > such that 

sup sup e Exq[t] < cxo, xq € -Da,7- 

Si 0<e<eo 

The article is organized as follows. In section two we give the rigorous definition of the tug-of- 
war. We also summarize some results of Peres and Sheffield and give our fundamental computational 
tool. Section three is devoted to the proof of Theorem II. 1|, using Theorem 11.21 In section four we 
prove Theorem 11.51 niaking use of some ideas of Burkholder (1977). Then we prove Theorem 11.31 
Finally, in section five we prove Theorem 11.21 



2 Preliminaries 

Let D C M'^ be open and connected. The noise measure ^ is a compactly supported mean zero 
Borel probability measure on R*^ which is preserved by orthogonal transformations of M'^ that fix 
the first basis vector ei. For each v G M , let ^ be \v\ times some orthonormal transformation of 
W^ chosen so that ^(ei) = v. Define a new probability measure on the Borel sets of W^ by 

fi,{B) = ^x{^-\B)). 

Since /U is invariant under orthogonal transformations of M*^ which fix ei, //„ is independent of the 
choice of ^. For i? > and z G M'^, let 

Br{z) = {x(^W^ ■.\z-x\<R} 

and set 

a = 1 + inf{i? : ii{Br{{))) = 1}. 

The tug-of-war in D, with noise ^, is played as follows. Let xq € .D be the initial game position. 
At the k turn, a fair coin is tossed. 

• If dist(a;fc_i, dD) > ae, then the winning player chooses Vj. € M'^ with \vk\ < e and the game 
position is moved to 

Xk = Xfc-l +Vk + Zk, 

where Zk is a random noise vector sampled from fi^^ . 

• If dist(a;fc_i, dD) < ae, then the winning player chooses Xk E dD with \xk — Xk-i\ < ae and 
the game ends. 

This is a basic description of the game movement. There are are many possible choices of payoffs; 
for instance, 

• the payoff can occur only when the game ends; 

• there is a running payoff at each stage of the game; 

• the payoff is a combination of the two. 

Also, there are related games that have been studied. See Peres et al. (2009), Peres et al. (2007), 
Lazarus et al. (1996), Maitra and Sudderth (1998) and Spencer (1977). 

Let TTj be the projection to the j^^ coordinate and use C = {Cij} to denote the covariance 
matrix of n: 

Cij = / ■Ki{x)T[j{x)d^{x). 

Note that C is diagonal and Ca = Cjj for 2 < i,j < d. Define 

/ X Cii + C22 + 1 
p = p{n) = . 



Then for some /3 > 0, with q being the conjugate of p, we have 

q 

Cii = -, 2<i<d. 
P 

The game history up to step A; is a sequence of moves 

hk = {xo,Vi,Xi,V2,X2, ■ ■ ■ ,Vk,Xk) 

regarded as an element of the set 



Hk = Dx ^Be{0) X D) ; 

we use the convention that if the game terminated at time j < k, then Vm = and Xm = Xj for 
m > j. The complete history space Hoo is the set of all infinite position sequences 

h= (xo,t'i,xi,t;2,X2,...) 

endowed with the product topology. A strategy is a sequence of Borel measurable maps from H^ 
to B^ (0) giving the move a player would make at the k step as a function of the game history. 

A pair of strategies (Si, Sn) for players I and II, respectively, and a starting point xq = x 
determine a unique Borel probability measure on Hoo- We will use E^ to denote the corresponding 
expectation. 

In what follows: 

• X G M will be regarded as a column vector; 

• x will be its transpose; 

• (x, y) will be the usual Euclidean inner product of x,y G M ; 

• ||Aj| = sup \Av\ will be norm of the d x d matrix A. 

\v\<l 

The infinity Laplacian operator is defined by 

du d'^u du 



Aoo^i = |Vnj 2, 



dxi dxidxj dxj 

when u is sufficiently regular. Then the p-Laplacian can be expressed as 

(2.1) A„n=-Au+( ) Aoo^i, 

p \q pj 

where A = A2 is the usual Laplacian. 

The following facts are proved in Peres and Sheffield (2008). Given a symmetric d x d matrix 
AandS.e M'^\{0}, define 

(j){x) = X Ax + (C,x) 



and 



■0(f) = Eq[(J){xi)\ player I won and chose v = vi ] 

(2.2) = Eq[(J){vi + zi)\ player I won and chose v = vi ]. 

Note we also have 

(2.3) V(^) = Eq[(J){vi + zi)\ player II won and chose v = vi ]. 
Then for 

(2.4) b=(^-^)a + ^(TiA)I, 

\q pj p 



we have 
(2.5) 

(2.6) 



ipiv) = {^,v) + V Bv, 



^P[^^=e\C\ + lA^^PiO)e^ 



and for e < 1, if vmax G -^^(O) is such that V'(f^MAx) is maximal, then 



(2.7) 



HvMAx) - e\C\ - -Aooi^iO) e"^ 



< — - — —e^. 



Since —tp is obtained from ip by replacing ^ and B by —S, and —B, respectively, the analogue 
of dZlD for -ip is 



(2.^ 



i; 






-e|^| + ^AooV(0)e^ 



Note that by (I23])-(I23D and dM 



\q pJ p 

(2.9) =/3Ap(/>(0). 

Lemma 2.1. Lei A be a symmetric d x d matrix and let ^ € M \{0}. Fix k > and let 

hk = (a:^o,'yi,a;i,'U2,X2,. . . ,Vk,Xk) 

be the game history up to step k. Set 

(t)i{x) = {x- XkfA{x - Xk) + (,£„x- Xk), X € R'^. 

i) Suppose at move k + 1, player I adds v to the game position if he wins and player II adds z 
to the game position if he wins. Then 



Exf^[(j)i{xk+i)\hk] = hi^iv) + l^p{z). 



ii) If player II's strategy at move k + 1 is to tug e units in the direction of —^, then for any 
strategy of player I, 



E^^^-,[(j)l{xk+l)\hk] < ^e^ + -Ap(j)i{xk)e'^, 



M 



w/iere M = 8/32(d + l)2p||2. 

Proof. By translation invariance of both the game and the infinity Laplacian, for 

^pl{v) = ExQ[(j)i{xk+i)\ hk, player I won at move k + 1 and chose Vk+i = v ] 
= ExQ[(j)i{xk+i)\ hk, player II won at move k + 1 and chose Vk+i = v ], 



we have 

(2.10) 

and 

(2.11) 



Mv) = {C,v)+v'^Bv (by (122]) and ([23D ). 



'^Pl{-^^=^e\^\ + ^A^M^k)e^ (by (USD) 
= -e\^\ + ^ApMxk)e^ (bydlJD). 



Moreover, for e < 1, by (|2.7p and (j2.9p we have 



(2.12) 



V'i(^^MAx) -e|?| - -Ap(j)i{xk)e 



< 



16 \\B\\^ 



where fMAX G -Se(O) is such that V'i(^MAx) is maximal. 

If /i^ indicates that at move /c + 1, player I chooses Vk+i = f if he wins and if hjj indicates that 
at move k + 1, player II chooses ffe+i = z if he wins, then we have 

Ex^[(l)i{xk+i)\hk] = l-E^o [4>i{xk+i)\hi] + ^E^g [(j)i{xk+i)\hl^] 
(2.13) =^Mv) + h^iiz) 

= lij{v) + iV(2) (by 03UD and (I23D ). 

This yields part i) of the lemma. 

As for part ii), the formula (|2.13p implies that 

E,xo[(j)i{xk+i)\hk] = -Mv) + ^V'l f -|7| 



< 



1 



£ lel + ^Ap Mxk) e^ + ,,, e^ 



+ 



1 



-e\(\ + (^ApMxk)e^ 



(by (J2J2]1 and (l2lT]) . respectively) 



<M.e'^ + ^ApM^k)e^ (bydiaD), 



as desired. 



D 
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3 Proof of Theorem 11.1 

Let 



r] < TT 



,_1 2(p-2) 
2V P 



Choose rji G I ??, tt 



1 



1 /2(p-l) 



and let u{x) = r'^f{9) be from Theorem 11.21 for the wedge 



Wrij^. The tug-of-war is translation invariant, so to prove Theorem I l.H it suffices to show that if 
Tw is the time to end the game in the translated wedge 

(recall a us from the beginning of section 2), then there is a strategy for player II and Eq > such 
that 



(3.1) 



sup sup e'^ Exo[tw] < oo, xq G W, 
Si 0<6<eo 



where the supremum is taken over all strategies for player I. 

We have u G C'^{W) and its second and third order partials are of the forms 

2 

3=0 

3 



lt.^mf^'\s), 



j=0 

respectively, where the /cj's and ij's are bounded. Thus for all i,j,k, 



(3.2) 

and 
(3.3) 



sup 

W 



dh 



dxidxj 



< 



sup 



dh 



dxidxj 



: X G Wr] and \x\ > a + 1 } < oo 



sup 

W 



Q3 



U 



dxidxjdxk 



< sup 



Q3 



u 



dxidxjdxk 



: X £ Wri and |x[ > a + 1 > < oo. 



These bounds are the reason why we must use the u corresponding to VF^j and translate Wr^ to 
W — they do not hold in Wr^ if we use the function corresponding to Wrj- A simple computation 
shows that 

|Vn|2 = r' [if + iff] , 



and since \Vu\ > on W^i\{0}, we have tthat 



(3.4) 



in_f \Vu\ > 0. 
W 



Thus for e < 2) given any y G W, for 7 = 2(a + 1), we have a Taylor expansion 



1 



(3.5) u{x) = u{y) + {Vu{y),x -y) + -(x-y) D u{y){x -y) + R{x,y), x e B^^iy), 



11 



where D^u is the matrix of second order partials of u and the remainder R{x, y) satisfies 
(3.6) \R{x,y)\<Ce\ 

with C independent of x, y and e < 2 • 
Proof of dM]). Define 



(3.7) 



Ci := C + 18/3^ sup ■ 



w 



\Vu\ 



where C is from dMD. Note that C^ < 00 by ((S^D and ((331) • For A; > 0, define 

Mk = u{xk) + ^e^ k - Cik e\ 

where Xk is the game position at step k for the tug-of-war in W . Then M^ is a supermartingale: 
Indeed, by the Taylor expansion (jS.Sp . we have 



E^^[Mk+i - Mk\hk] = E^ 



u{xk+i) - u{xk) + TT e^ - Ci£^ 



hk 



< E. 



xo 



(Vn(xfc), Xfc+i - Xk) + -(a:^fc+i - Xk) D u{xk){xk+i - Xk) 



+Ce^ + ^E''-Cie^ 



hk 



E. 



XO 



(Vn(xfc), Xfc+i - Xk) + -{xk+i - Xk) D u{xk){xk+i - Xk) 



(3.8) 



+ {C-C,)e^ + ^e' 



hk 



For ^ = 'Vu{xk) and A = -^D u{xk) in LemmaET] a simple calculation shows that the corresponding 
4>i satisfies 



(3.9) 



^p(f>i{xk) = Apu{xk) 



-1. 



Now assume that player II uses the strategy such that at the k position Xk, he moves e units in 
the direction of —Vu{xk) if he wins and player I uses any strategy if he wins. Then by part i) of 
Lemma |2. 11 for 

M = lSP^\\D''u{xk)\\\ 

we have from (13. 81) that 



Exo[Mk+i - Mk\hk] < E.,,[Mxk+i)\hk] + {C- Ci) e^ + ^e^ 



< 



M 



\Vuixk)\ 
M 

|V'U(XA;)| 



e' + ^Ap Mxk) e^ + {C- Ci) e' + ^e^ 



2 



e^-^e^ + {C-Ci)e^ + ^e'' 
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(by (ED) 



<0, 



by choice of Ci from (j3.7p . Thus Mk is a supermartingale, as claimed. 
By optional stopping, for A; > 0, 



u{xo) = Mo > E^,[MkArJ 



E. 



XO 



>e' 



u{xkATw)+2^ {k A Tw) - Cie-^ {k A Tw) 
E^glkATw]- 



2 



Taking Eq G (O, 2) so small that ^ — Cie > for all e < Eq, we can use monotone convergence on 
the left to end up with 



/? 



Cie 



Exo[tw] <u{xo). 



Then 



giving (|37T| . 



sup e^E'^Jr^] < 00, xq G W, 

0<£<£0 



This completes the proof of Theorem 11.1 



D 



4 Proof of Theorem 11.51 and Theorem 11.31 

Theorem 11.51 is an immediate consequence of the following theorem. 

Theorem 4.1. For the tug-of-war in W^^, there is a strategy for player I such that the time r to 
end the game satisfies 

E^^^[t] = oo, xq e Wt,, 

for any strategy used by player II. 

Proof. Let u{x) be the projection 7ri(x) onto the first coordinate. Suppose player I's strategy at 
play /c + 1 is to move e units in the direction of Vn(xfc) if he wins. To get a contradiction, assume 
there is a strategy for player II such that 



(4.1) 



E^oIt] < oo. 



For ^ = Vu(xfc) and A = ^D'^u{xk) = in Lemma 2.1, we see the corresponding matrix B from 
(12. 4p satisfies B = and it is easy to show that the corresponding (pi satisfies 

Ap(/)i(xfc) = 0. 
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Then by part i) of the Lemma, with v denoting the move player II makes at move k + 1 when he 
wins, 



Exo [u {xk+i) -u{xk)\ hk] = E^^ 



1 



{Vu{xk),Xk+i - Xk) + i:{xk+i - Xk) D u{xk){xk+i - Xk) 



hk 



5*' (I) + 5*'"' 



4ko 



+ ^[(C,^) + o] 



^M^\ + {^,v)] 



>o, 

since \v\ < e. Thus u{xk) is a submartingale. 

Let u (xt)* be the maximal function defined by 

U {Xr)* = SUTpu{Xk). 

Recalling that 7 = 2(a + 1), choose /3i > 1 + 76 and then let 6 G (0, 1) be so small that 



(4.2) 



< 1. 



A - 1 - 76 
With the good- A inequalities of Burkholder (1973) in mind, we now show that 

7e5 



(4.3) Px, {u{xrT > /3iA, T + u{xo) < dX) < 



-Pxo {uixrT > A) , A > 0. 



/3i - 1 - 76 

To this end, note that if u{xq) > 6X, then the left hand side of (j4.3p is zero and the inequality is 
trivial. Thus it is no loss to assume u{xo) < 6X. Let 



^ = inf{A; > : u{xrAk) > A}. 



Then 



A < u{x^) < (1 + 7e)A on {^ < 00} = {u{x^)* > A}. 
For a = 5X — u{xq) and [ • ] denoting the greatest integer function, we have 



Pxo {uixr)* > /3iA, T + u{xq) < dX) = P^q [ ^ < 00, t < a, sup u{xk) > /3iA 



< -Pxo K < 00, sup \u{xk) - u{x^)\ > (/3i - 1 - 7e)A 
V i<k<^+[a] , 



(4.4) 



E, 



XQ 



k<ooPx^ sup \u{xk) - u{x^)\ > (^1 - 1 - 7e)A 

\k<[a] , 
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Now \u{xk) — u{xo)\ is a nonnegative submartingale, so by Doob's inequality, 

Pa; sup \u{xk) - u{x)\ > (/3i - 1 - -fe)X < r-E^ [ \u{xia]) - u{x)\ ] 



,fc<[al 



(/3i - 1 - 7e)A 






(where we take xq = x in the summation) 



< [ahe 



{(3,-1- je)X 



(using that u = tti] 



^ h^ 



Using this in (j4.4p . we get ()4.3p . Then by Lemma 7.1 in Burkholder (1973), 

ExQ [u{xr)*] < CzE^o [t + u{xq)] , 

where 

Cs = f3i6-' ( 1 



r-l / 1 Plh^ 



Combined with (14. ip . this implies that the family 

{u (xrAk) ■■ k>0} 
is uniformly integrable. By optional stopping, since u{xk) is a submartingale, 

u(xo) < -Exo [^^(a^rAfc)] 

and by the uniform integrability, we can let A; — )• oo to get to end up with 

<'U(X0) <^xo [u{xr)\ =0. 
This yields the desired contradiction and the proof of Theorem 14.11 is complete D 

Proof of Theorem 11.31 Let A be the set of all rj G (0, 27r) such that for some strategy of player 
II, the time r to end the tug-of-war in W^ satisfies 

Exo[t\ < oo, 

regardless of the strategy used by player I. Then it suffices to show that A ^ %, for in that event 
we take rjp = sup^. But by Theorem ll.il ^ 7^ 0, as desired. D 
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5 Proof of Theorem 11.2 



The proof of Theorem 11.21 is long and technical, so before giving the details, we motivate om' 
argument. If u{x) = r'^f{6) > is a C^ solution to 



ApU 



-1 in Wr, 



u = on dWr,, 
then it is a routine matter to show that on (— ^, ^), 



(5.1) 



4/^ 



i+2/+ir 



+ (/ 



•/\2 



1 + 



2(3p-4) f j^P^ f" 



0. 



By symmetry we expect to have /'(O) = 0. Thus it should suffice to consider (|5.ip on (O, ^) with 

(5.2) /'(0)=0, /(2)=0. 

For this, set 

y = / and a = /(O), 

and then make the transformation 

(5.3) H,iy) = {y'f. 
This converts (j5.ip into the equation 



(5.4) 
and since 



V l + 2y + lH'M +Ha{y) 



1 + 



'-^y + '-^H'M 



Ha{a) = Haivm = {y'{0)f, 
the condition (j5.2p tells us that 

(5.5) Ha{a) = 0. 

Modulo technicalities, (j5.3p yields an implicit representation of y = f{0): 



dw 



y{e) ^/hJw)' 



0e(o,2). 



v 



dw 



dw 



(5.6) 

In particular, 

(5^7) _ 

2 Jy(r,/2) y/Hjw) Jo ^/hJw) 

Our approach is to work backwards from (|5.4p - (|5.5p . Thus we need to show for each a > 0, there is 
a solution Ha to (|5.4p on (0, a) satisfying Ha{0) = 0. Then using (jS.Sp and (j5.6p . we get an implicit 
solution / = y of ()5.ip . There will be some 9a > such that y{9a) = and y > on (0,0a). In 
light of (j5.7p . we need to show that for some a > 0, 

2 "" Jo y/lUw)' 
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This will happen if we show 9a is continuous as a function of a > with 0^ — )■ as a — ?> 0^ and 

dw 



lim 



TT 



1 



1 2{p-l) 
2V p 



»^~7o yjHa{w) 2 
The latter is hard to prove directly. The trick is to change variables 

Ga{y) = {ay)-^Ha{ay), < y < 1. 

This converts the equation (j5.4p to 

8p [ i + 2y ] + [ ^ + 4(3p - 2)y + 2{p - l)yGa{y) 1 G,(y) 



(5.8) 



G'a{y) 



y'^[A + {p-l)Ga{y)\ 



We will show G^ is decreasing in a and converges to a function K which solves the equation resulting 
from taking the limit of (jS.Sp as a — >• oo. Then 



lim 



dw 



lim 



dn 



du 



"^^JO y/Ha{w) "-^ocJo UV^Ga(M) io U^/K(u)' 

The latter can be easily computed using residues, upon making an appropriate change of variables. 

We point out that (j5.4p can be reduced to an Abel differential equation of the second kind 
(see Polyanin and Zaitsev (2003)). There are some equations in this family that have parametric 
solutions or can be solved explicitly in terms of tabulated functions, but (j5.4p is not one of these. 
Panayotounakos (2005) has given exact analytic solutions, but the form corresponding to (j5.4p is 
unwieldy and seems impossible to use for our purpose. 

Now we give the details. For o, y > and w > —^-j-, define 



(5.9) 



Fa{y,w) 



[-a+'^y] + \^+^{'iv-2)y + 2{p-l)yw 



w 



y2 [4 + (p_ i)w] 



Lemma 5.1. For each a > 0, there is a unique solution Ga G C°°((0, 1]), with Ga > on (0, 1), 
of the boundary value problem 



(5.10) 



G'a{y) = -Faiy,Gaiy)) 0<y<l 
Ga{l) = 0, 



and Ga is continuous and strictly decreasing on (0,1]. Moreover, for each y € (0,1), Ga{y) is a 
continuous function of a > 0. 

Remark. When we say G G C°°((0, 1]) we mean that for some 6 > Q, G has an extension in 
C°°((0,l + (5)). 

Proof. It is easy to check that there is some 5 € (0, 4) such that if u; > —5, then 

4 + (p - l)u; > 
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and 

8p + 2(3p - 2)w + {p- 1)^2 > 0. 
In particular, for y > and w > —5, 

5.11 F, y, w) = -^ ^ 2u/r -^VT^ -^ > 0- 

y^[4 + (p- l)w\ 

Since Fa € C°°((0, oo) x [— (^, oo)), by the Fundamental Existence/Uniqueness Theorem for ordinary 
differential equations (Coddington and Levinson (1955), Theorem 3.1 on page 12), for some 6i > 0, 
there is a unique solution G £ C^{{1 — 6i,l + 6i)) to 

G'iy) = -Fa{y,Giy)), y g (1 - 5i, 1 + <5i) 
G(1)=0. 

Note it is tacit that G > —6 on (1 — 6i,l + 5i). Since 

G'(l) = -F,(1,G(1)) = -F,(1,0) = _M1±M < 0, 

a 

there is some 62 S (0, ^i) such that G is strictly decreasing on (1 — ^2) 1]- Then from ()5.1ip we see 
that G can be uniquely extended to (0,1 + 5i) (see Theorem 1.3 on page 47 in Coddington and 
Levinson (1955)), to be the solution in C^((0, 1 + ^i)) of 

j G'{y) = -Faiy,G{y)) < y < 1 + 6^ 
(5.12) <^ 

\ G(l) = 0. 

Moreover, G is strictly decreasing and continuous on (0, 1]. Thus G > on (0, 1), and by repeatedly 
differentiating KW . we see that G € C°°((0, 1 + 5i)). Upon setting Ga = G, it follows that (|5T0]l 
holds and Ga is continuous and strictly decreasing on (0, 1]. 

Since Fa{y,w) satisfies a Lipschitz condition in w uniformly for {y,w,a) in compact subsets 
of (0,00) X [0, co) X (0,00), by standard theorems for ordinary differential equations involving 
parameters (Coddington and Levinson (1955), Theorem 7.4 on page 29), for each y S (0, 1), Ga{y) 
is a continuous function of a > 0. D 

The next order of business is to show Ga decreases as a function of a > 0. 

Lemma 5.2. If < ai < 02, then Gqj < Ga^ on (0,1). Moreover, for each y G (0,1), 
lima-^o+ Ga{y) = 00. 



Proof. For typographical simplicity, write Gq. = Gj and F^. = Fj, where Fa is from (j5.9p . We use 
Dl g to denote the left derivative of g: 

r> ( \ V 9{y + h) -g{y) 
DLg[y)= lim . 

h^o- h 



18 



Since 
(5.13) 
we have that 

Consequently, 

Hence for small 5 > 

(5.14) 



G^iy)= I F,iu,Giiu))du, 0<y<l, 
Jy 



£»LGi(l) = -F,(l,0) = -2p 
DlG2{1)-DlGi{1)=2p\--- >0. 



!p 


i + 2 




L OLi 


1 1 " 


ai 


«2 



= 2p 


1 

ai 


1 

0-2 


>0. 







G2{y)<Gi{y), y ^[1-5,1). 
To get a contradiction, assume that for some yo £ (0, 1 — f^) we have 

G'2(yo) = Gi(yo). 
Let y* < 1 — (5 be the supremum of all such points yo- Then G2{y*) = Gi(y*) and 
(5.15) G2{y)<Gi{y), yG(y*,l). 

On the other hand, by (j5.12p and that G2{y*) = Gi(y*), using D^ for the right derivative, 

DRG2{y.) - DRGi{y.) = G'^iy,) - G[{y.) 

= Fi{y*,Gi{y^)) - F2{y*,G2{y*)) 

[4 + gi(j/.)] 
y2[4+(p-l)Gi(y,)] 

>0. 

Hence for small 5i > 0, 

G2 > Gi on {y^,,y^, + 61]. 

This contradicts ()5.15p . Thus there is no yo S (0, 1 — 5) for which G2{yo) = Gi(yo) and so by (j5.14p . 
we must have G2 < Gi on (0, 1), as claimed. 

To see that lima^o+ Ga{y) = 00 for each y G (0, 1), assume that for some yo G (0, 1), 

lim Ga(yo) = g{yo) < 00. 

Then since Ga{y) is decreasing in both a > and y G (0, 1), for any y G (yo, 1) we have that 

lim Ga{y) < lim Ga(yo) < 00. 

a->0+ a-5-0+ 

Thus y(y) = lim^_j.o+ Ga{y) exists as a real number for each y G (yo, 1). By Fatou's lemma we have 
that 

1 r-l 

liminf Fa(ti, Ga(^i)) dn < liminf / Fa{u,Ga{u)) du 

n a^0+ a^0+ Jy, 



yo 



liminfGa(yo) (see (1SI2D). 
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On the other hand, since Ga{u) -^ g{u) for n G (yo, 1), by (j5.9p we have that 



Thus 



hm Fa{u,Ga{u)) = oo. 

O-S-0+ 



oo = hminf Ga(yo) = g{yo) < oo; 

a-j.O+ 



contradiction. D 

As a consequence of Lemma 15.21 the function 
(5.16) K{y) = hm Gaiv), < y < 1 

a— j-oo 

is well-defined and K{1) = 0. 

Lemma 5.3. The function K is decreasing on (0, 1] and is positive on (0, 1). 

Proof. Since Ga{y) is strictly decreasing and nonnegative as a function of y € (0, 1], K must be 
decreasing and nonnegative on (0, 1]. If for some yo € (0, 1) we have K{y) = 0, then by monotonicity 
and nonnegativity, iiT = on [y^,!]- By Fatou's lemma and (|5.13|) . 



(5.17) [ F^iu,K{u))du= [ Urn Faiu, Gain)) du 

Jyo Jyo °^~ 

< liminf / Fa{u,Ga{u)) du 

«^~ Jyo 

= liminf Ga(yo) 

a— )-oo 

= K{yo) 
= 0. 

On the other hand, for each u G [yo, 1], we have that 

16p + 4(3p - 2)K{u) + 2{p - l)K^{u) 



Foo{u,K{u)) 



u[A+{p-l)K{u)] 



4n 

->o, 

u 



since i^ = 0, on [yo, 1]- Thus the left hand side of ()5.17p must be positive. This contradiction yields 
that we must have -RT > on (0, 1). D 

Now we show that we can take the limit as a ^ oo in ()5.10p . 

Lemma 5.4. The function K is continuous on (0, 1) and satisfies 

16p + 4(3p - 2)K{y) + 2{p - l)K^iy) 



K'{y) 



y[4 + (p-l)K(y): 
Foo(y,i^(y)), 0<y<l. 
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Proof. By ()5.16p . Lemma 15.21 and Lemma 15.31 for sufficiently small 5 > 0, if y € (0, 1 — 5), then 

Ga{y)>K{y)>K{l-6)>0, a > 0. 

Notice that for n € [5, 1 — 5] and w > 0, 

< Fa{u,w) - Fooiu,w) 
2p{4 + w) 



< 



au'^[A+ {p- l)w] 
2p 



x52 



1 + 



1 



p — 1 



This implies that as o ^ oo, Fa{u,w) — )• Foo{u,w) uniformly for n G [5, 1 — 5] and tt; > 0. In 
particular, for 



Na = sup{\Fa{u,w) - F^{u,w)\ : 6 < u < 1 - 5, w>K{l-5)} 



we have 



Na ^ as a — )• oo. 

Since the u^-partial of Fooiy, w) is of the form 

fi{y)w'^ + f2{y)w + h{y) 
y'^[A + {p - l)wf 

where /i"/3 are bounded on [0, 1], we have that 

5Foo 



M := sup 



dw 



■{y,w] 



■ 6 <y <l-d, w>K{l-6)}<oo. 



Then for any u G [6,1 — 6] and wi,W2 > K{1 — 5), 

\Fooiu,wi) - Fooiu,W2)\ < M\wi -'«;2|, 
and consequently, 

|-^ai('U,'"^l) - Fa2{u,W2)\ < \Fa-^{u,Wi) - Foo{u,Wi)\ 

+ |Foo(n,Wi) -Foo(n,W2)| + |-Foo('U,'«^2) - Fa2{u,'W2) 
<Na, +M\wi-W2\+Na^. 

Hence for any ai , 02 > 1 and y G [5,1 — 5], hy (j5.13p we have that 



[GaAy)-GaM\ 



f-y ry 

GaM- Fa,{u,Ga,{u))du-Ga,{S)+ Fa^{u,Ga^{u)) du 

Js Js 

< [GaAS) - Ga,{S)[ + r [FaAu,Ga,iu)) - Fa,iu,Ga,iu))[ du 

< [GaA^) - Ga,m +Na,+M j' [GaA^) " GaM\ du + Na,. 
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By Gronwall's inequality, 

sup \Ga,{y)-GaM\ < [\Ga,{S)-Ga,i6)\+Na,+Na,]e''^'-^'\ 

Since GaiS) —5- K{6) as a — )• oo, it follows that for any sequence a„ — >• oo, Ga„ is uniformly Cauchy 
on [6, 1 — 6]. Since 6 > was arbitrary, we get that K is continuous on (0, 1). 

Then by the uniform convergence of Ga to K on compact subsets of (0, 1) as a — )■ oo, we can 
take the limit inside the integral in the expression 

Ga{y) = Ga{S) - r Fa{u, Ga{u)) du, 6<y<l-6 

to get 

K{y) = K{5)- I F^{u,K{u))du, 6<y<l-5. 

Hence, since 6 > was arbitrary, 

K'{y) = -Foo{y,K{y)), < y < 1. 

Lemma 5.5. The function K is continuous on (0, 1]. 



D 



Proof. By Lemma 15.4^ it suffices to show that liuiy^i- K{y) = 0. Given e > 0, choose (5 > such 
that 

Gi(y)<e, yG[l-(^,l]. 

Then 

< Ga{y) < e for all y € [1 - 5, 1] and a > L 

Let a — 7- oo to get that 

0<i^(y)<e, ye [1- (5,1]. 

Thus K{y) — )• as y — )• 1~, as desired. D 

To prove integrability properties of K on (0, 1), we will make use of the following result. 
Lemma 5.6. We have the following limits: 

a) lim = 4p. 

y^i- l-y 

h) lim i^^^M = 2. 
j/^o+ -logy 
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Proof, a) Since K(y) —?■ as y —?■ 1 , we have 






lim F^{y,K{y)) 



= Ap. 

b) Now for y > and w >0, 

Foo{y,w) > 



y[4:+ip- l)w] ■ 
To get a contradiction, assume 

lim K(y) = L < oo. 

Then since K is decreasing on (0, 1), we have K{u) < L for u € (0, 1) and consequently for y > 0, 

K{y)= f Foo{u,K{u))du 
Jy 

-J, ^4 + (p-l)L]''^ 
16p 

Letting y —^ 0~^ , this yields oo > L = limj^^o+ ^iv) = ^^o; contradiction. 
Thus K{y) ^ oo as y — 7> 0^ and we have that 



2/^0+ -logy y^o+ -1/y 

:y,i^(y)) 

1 16p + 4(3p-2)K(y) + 2(p-l)K(y)2 



hm -^Foo(y,K(y)) 
y^o+ K{y) 



j; ™+ i^(y) 4 + (p - l)i^(y) 

= 2. 

D 
As an immediate consequence of the lemma, we get the following corollary. 

Corollary 5.7. The function y~^K{y)~^''^ is integrahle on (0,1). D 

For each a > 0, define 

(5.18) Ha{y) = y^Ga{y/a), < y < o. 

Then Ha is continuous on (0,a], Ha > on (0, a) and Ha{a) = 0. Moreover, Ha satisfies 

.,,Q^ f./. ^ 8py^[l + 2y] + [2p + 4(3p - 4)y]g,(y) „ ^, ^ ^ 
^'■''^ ''«^^) = 4y^ + (p-l)i^.(y) ' °<^<" 
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Lemma 5.8. The function Ha is positive on [0, a) and in C°°{[0,a]). 



Proof. By LemmaEH Ga G C°°((0, 1]), so we have Ha G C~((0,a]). 

Now if y > is very small, 2p + 4(3p — 4)y > 0. Hence H'aiy) < for small y > 0, and we have 
that Ha{y) is increasing as y decreases to 0. Thus 

L := lim Ha{y) 



exists as an extended real number in (0, oo]. 
If L = oo, then 






2p 
p-1 



Since 



Ha{y)- j'' H'a{u)du = Ha{e) 



for < s < y, we get a contradiction when e ^ 0^; thus we must have L < oo. Then by an 
extension theorem in Coddington and Levinson ((1955), Theorem 1.3 on page 47), for some 6 > 
the function Ha{y) can be uniquely extended to be the solution in C^{{—6,a)) of (J5.19P satisfying 
the initial condition Ha{a) = 0. Moreover, by making 5 smaller if necessary. Ha > on (—6, a) and 
so by repeatedly differentiating (j5.19p . we get that Ha G C°°{{—6,a)). D 

Since Ga > K on (0,1), by Corollary EZl {Haiy))'^/'^ = y-^{Ga{y/a)y^/'^ is integrable on 
(0,a). Thus the function 

r dy 

It T^M' 



(5.20) 



9{t) 



t G [0, a] 



is well-defined and continuous on [0, a]. Furthermore, since g is strictly decreasing on [0, a], it has 
a continuous and strictly decreasing inverse that we denote by yiO). Thus setting 

(5.21) ea = <7(0), 

we have that the domain of y{6) is [0, ^^ ]• In particular. 



(5.22) 

From this we get 

(5.23) 



dw 



(0) y^Hjwj 



O&[O,0a'. 



y'{9) = -y/Ha{y{e)), < 6 < Oa 

y{Oa) = 0, 

2/(0) = a 
2/>0on [0,0a). 



Now extend y{9) to [—6a-,Ga] by 



y{e) = y{-e), 



G 



9a, 0). 
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Lemma 5.9. The extended function y{9) is in C {[—9a,0a]) and satisfies the equation 
on {—9a,0a)- Moreover, y > on {—Oa,Oa) and y{ziz6a) = 0. 



4y2 



1 + 2y + iy" 



1 , 2(3p-4) I p-1 // 



Proof. By ()5.23p . y' = —y/Ha{y) on (0, 9a)- Since i:fa satisfies (|5.19p . it is a routine matter to check 
that y satisfies the indicated differential equation on {0,6a)- Then using that y'{0) = —y'{—9) for 
6 G (— 6'a,0), it fohows that y also solves the differential equation on (— 0a,O). 

By dSSSD, y > on {-Oa^Oa) with y(±6'a) = 0. Since ^((0,61^]) = [0,a) and i/„ > on 
[0,a), by Lemma 15.81 we can repeatedly differentiate the differential equation in (|5.23|) to see that 
y G C7-((O,0a]). Thus y G C7-([-e„0) U (O,0J). 

All that remains is to show that y is three times continuously differentiable at 0. We make 
use of the following fact: Suppose / is continuous on {—5,5) and differentiable on (— 5, (5)\{0}. If 
lim;^_^o- /'(^) = L = lim/j^o+ /'(^)) then the left and right derivatives of / at exist and are equal 
to L- Thus / is continuously differentiable at and the value of the derivative there is L. 

Now on {0,9 a), 

y' = -^/Ha{y), 

y" = lK{y), 

y'''^ = lH':{y)y'- 



Thenon (-6'a,0), 



and we have 



y'{e) = -y'{-e), 
y"{e) = y"{-e), 

y(3)(0) = _y(3)(_ 



limy'{e) = - lim y^IlMOT) 



Thus 



-VHa{a) 
0. 



lim y'{e) = - lim y'{-9) = - lim y'{9) = 
9-1.0- e-s>o- 6^.0+ 



and so y is continuously differentiable at with y'(0) = 0. 

Next, 

\im y" {6) = I lim H'a{y {6)) 
0— >-0+ z g— >0+ 

= -p{l + 2a), bydSin]), 
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and so 



lim y"(e) = lim y"(-9) = lim y"(e) = -p(l + 2a). 



Thus y' is continuously differentiable at and y"(0) = — p(l — 2a). 

Using (j5.19p . it is easy to check that lim0^o+ ^"{yi^)) exists. Hence we have that 

limy('\e) = \ Ihn H':iyi9))y'i9) 
■ " 2 6l->0+ 



e-+o+ 



0, 



and consequently, 



■ lim y^^\e) = 0. 



lim y^'^\e) = - lim y^^\-e) 
It follows that y" is continuously differentiable at and y'^'(O) = 0. 
Lemma 5.10. The root 6a is continuous and increasing as a function of a > 0. Moreover, 



D 



vr 



lim 0n = — 



^-w-^ 



p 



--■Tip 



and the range of 6a as a function of a > is (0, rjp) 
Proof. Observe that 



dw 



y/Haiw) 
dw 



(5.24) 



wy^Ga{w/a) 
1 du 



/o u^/GJu) 

Since Ga{ ■ ) is decreasing as a function of a > 0, 6a is increasing for a > 0. By Lemma IS.l) since 
Ga > K and y~^(K{y))~^''^ is integrable, we get that 6a is a continuous function of a > 0. Then 
by monotonicity, 

lim da = lim 



du 



«-^°° /o Uy^Gjuj 
"1 du 



/o u^/K{u) 

Upon changing variables y = K{u) and using Lemma |5. 6b together with the expression for K'{u) 
from Lemma 15.41 we get that 

4 + (p-l)y ^^^ 



a^ " 7o y^/^ [ 16p + 4(3p - 2) y + 2(p - 1) y^ ; 
After another change of variables y = z^ , this becomes 



\im6 =2 /"^ ^ + (^ - ^)^' 

a-^oo " y^ 2(p - 1)^4 + 4(3p - 2)^2 + 16p 



dz. 
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The latter integral is easily evaluated using residue theory to yield 



lim Oa = - 

a— J-oo Z 



,_1 2(p-2) 

2V p 



as desired. 

To see that the range of 9a is (0, rjp), it is enough to show that 

hm 9a = 0. 

Since u~^{Ga{u))~^''^ < u~^{K(u))~^''^ and the latter is integrable, by Lemma 15.21 and dominated 
convergence, ()5.24p yields 



lim 9a = lim 



du 



a-)-0+ a-^O+Vo UyjGJu) 

At last we can prove Theorem 11.21 Let 



0. 



D 



T] < IT 



1 2(p-l) 



By Lemma |5.10|, choose a > such that 9a = 3. Taking f{9) to be the corresponding y{9) from 
Lemma 15.91 and setting u = r'^f{9) does the trick. 
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